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1  Introduction 

The  proposal  we  submitted  for  this  grant  was  to  use  tools  that  we  have  developed  in  previous 
years  to  improve  the  robustness  and  adaptability  of  agent  teams.  The  assumption  was  that  we 
would  collaborate  with  Paul  Wiegand,  who  was  specifically  studying  these  issues  in  team  learning. 
Unfortunately,  Paul  left  NRL  early  during  this  grant,  so  we  decided  to  modify  our  goal. 

At  a  more  abstract  level,  our  goal  was  to  use  tools  based  on  quantitative  genetics  [4]  theory 
in  order  improve  Evolutionary  Algorithms  (EAs)  for  use  with  team  learning  tasks.  Up  until  now 
our  work  has  focused  largely  on  Price’s  theorem  [6].  We  decided  to  take  a  step  back  and  review 
the  quantitative  genetics  literature  more  widely,  with  the  ultimate  goal  of  applying  anything  we 
discovered  to  team  learning. 


2  Theory 

Price’s  theorem  measures  the  average  effect  of  selection  and  variation  from  one  generation  to  the 
next.  During  our  previous  work  [5]  [1]  [2],  we  discovered  that  the  variance  of  these  effects  is 
also  important  to  understanding  the  evolutionary  process.  We  suspected  we  were  not  the  first  to 
discover  this,  and  decided  that  a  larger  review  of  the  quantitative  genetics  literature  was  in  order. 

Our  review  made  it  clear  that  the  biologist  also  place  a  high  emphasis  on  measuring  phenotypic 
variance.  What  we  noticed  though  was  that  all  of  their  equations  make  assumptions  about  the 
form  of  the  genetic  representation  (DNA  of  course).  One  of  the  reasons  that  Price’s  theorem  has 
been  so  useful  for  us  is  that  it  makes  no  such  assumption.  EAs  can  and  do  use  a  wide  variety  of 
representations  that  are  not  easily  analyzed  by  these  equations.  LISP  trees  and  Neural  Networks  are 
just  two  such  examples.  In  their  current  form,  these  variance  equations  would  only  be  applicable 
to  a  limited  number  of  EAs. 
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We  chose  to  create  a  new  variance  equations  that  is  representation  independent.  Using  Price’s 
equation  as  a  guide,  we  derived  a  variance  equation  which  eliminated  any  reference  to  genes  ard 
alleles,  and  only  measures  phenotypic  traits.  Like  Price’s  equation,  the  equation  is  separated  imo 
several  terms,  each  of  which  is  gives  insight  into  an  aspect  of  the  evolutionary  process.  One  term 
measures  the  resemblance  between  parents  and  offspring  (heretability)  and  the  other  measures  how 
the  phenotype  space  near  the  parents  are  explored  (resampling?). 

This  has  helped  me  to  improve  my  personal  model  of  how  an  EA  works.  Much  like  Eshelman’s 
[3]  description  of  Convergence  Controlled  Variation,  we  believe  that  an  EAs  heuristic  works  as 
follows.  An  EA  searches  gradually  smaller  and  smaller  sections  of  the  space  until  a  solution  is 
found.  At  any  given  time,  the  area  most  likely  to  contain  a  solution  described  by  the  population. 
Selection  is  the  mechanism  by  which  the  scope  of  the  search  is  reduced,  focusing  in  on  more 
promising  areas.  The  job  of  the  reproductive  operators  is  to  resample  the  same  area  described  by 
the  parent  population,  thereby  continuing  the  search,  but  mainly  within  the  promising  areas. 


3  Application 

Using  this  model  of  an  EA,  we  was  able  to  reason  about  issues  we  had  seen  in  prior  work  with  Pitt 
Approach  rule  systems.  The  custom  operators  typically  used  with  these  EAs  can  often  make  large 
changes  to  individuals  still  very  late  in  an  evolutionary  run.  In  addition,  the  representations  often 
used  have  the  can  create  both  over  and  under  specifications  in  the  decision  (or  feature)  space. 

Given  my  new  understanding,  we  reasoned  that  a  representation  which  was  more  like  a  kNN 
learner’s  representation  would  be  less  likely  to  result  in  large  phenotypic  changes  if  an  individual 
rule  was  added  or  removed.  Also,  we  devised  a  new  crossover  operator  which  performs  its  cuts 
in  feature  space,  segregating  rules  rules  based  on  which  side  of  a  randomly  chosen  hyperplane 
they  fall,  rather  than  on  their  position  on  the  genome,  we  reasoned  that  this  would  result  in  much 
smaller  changes  between  parents  and  offspring  toward  the  end  of  the  run. 

Experiments  performed  using  these  techniques  had  a  very  interesting  effect.  We  expected  them 
to  result  in  solutions  with  improved  classification  accuracies.  Instead  the  solutions  had  the  same 
classification  accuracy  as  when  more  standard  representations  and  operators  are  used,  but  the  sizes 
of  the  rule-sets  were  much  smaller.  This  approach  appears  to  offer  a  solution  to  the  long-standing 
problem  of  bloat  in  EA  learning.  We  plan  to  publish  these  results  in  an  upcoming  conference  once 
we  can  perform  a  more  rigorous  set  of  experiments. 


4  Conclusions 

Our  collaborative  effort  this  year  has  produced  two  main  results.  First,  we  have  managed  to  mod¬ 
ify  quantitative  genetics  variance  equations  to  a  form  that  will  make  them  applicable  the  EAs  in 
general.  And  second,  we  have  used  our  new  understanding  of  EAs  in  order  to  improve  an  existing 
EA  learning  algorithm.  These  contributions  will  benefit  both  NRL  and  GMU. 

There  is  a  clear  path  here  for  future  work  as  well.  This  should  include  the  construction  of 
tools  based  on  the  new  variance  equation  to  be  used  for  analyzing  customized  EA  representations 
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and  operators.  These  will  be  much  like  way  our  tools  based  on  Price’s  theorem.  Also,  we  should 
use  these  tools  with  the  Pitt  approach  algorithm  to  demonstrate  that  our  modifications  really  did 
produce  the  results  we  intended. 
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